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Abstract 



The paper studies different variants of almost periodicity notion. We introduce the class 
' of eventually strongly almost periodic sequences where some suffix is strongly almost periodic 

(=uniformly recurrent). The class of almost periodic sequences includes the class of eventually 
strongly almost periodic sequences, and we prove this inclusion to be strict. We prove that the 
class of eventually strongly almost periodic sequences is closed under finite automata mappings 
and finite transducers. Moreover, an effective form of this result is presented. Finally we consider 
c/3 , some algorithmic questions concerning almost periodicity. 

1 Introduction 

> 

■ Strongly almost periodic sequences (=uniformly recurrent infinite words) were studied in the works 

Q . of Morse and Hedlund ^ |5j and of many others (e. g., see [Hill). A sequence is strongly almost 

I periodic if every its factor occurs infinitely many times with bounded distances. This notion first 

appeared in the field of symbolic dynamics, but then turned out to be interesting in connection 
1 ^ . with computer science, mathematical logic, combinatorics on words. Almost periodic sequences 

^ I were introduced in while studying logical theories of unary functions over N. A sequence is 

J-^ ' almost periodic if every its factor either occurs infinitely many times with bounded distances or 

occurs only finitely many times. We introduce a new class of sequences called eventually strongly 
^ , almost periodic, where some suffix is strongly almost periodic. Then we study some properties of 

H ' this class. 

This paper is organized as follows. 

In Section we give the formal definitions of different generalizations of periodicity notion. 
The class of almost periodic sequences includes the class of eventually strongly almost periodic 
sequences. We prove this inclusion to be strict (Theorem^. 

Section 121 concerns automata mappings. Almost periodic sequences were studied in detail in |121 
C]. In particular, the authors prove that the class of almost periodic sequences is closed under finite 
automata mappings (=mappings done by synchronizing finite transducers). Evidently, the class 
of finite automata mappings of strongly almost periodic sequences contains the class of eventually 
strongly almost periodic sequences. The main result of the article (Theorem|21) states the equality of 
the classes. In other words. Theorem |31 says that finite automata preserve the property of eventual 
strong almost periodicity. Moreover, an effective variant of this theorem is proved (Theorem |1J). 
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supported by RFBR grants 06-01-00122, 05-01-02803, Scientific Schools grant 358.2003.1 and Kolmogorov grant of 
Institute of New Technologies. 
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Then we consider a generalized version of finite automaton, i. e., finite transducer, and prove the 
same statement for it. 

In Section0]we deal with some algorithmic questions connected with almost periodicity. Namely, 
we prove that some problems or properties do not have corresponding effective analogs (in contrast 
to Theorem 13] with effective version in Theorem |1J). For instance, we prove that given eventually 
strongly almost periodic sequence and its regulator we can not find any prefix which is enough to 
cut to obtain strongly almost periodic sequence. 

Let us introduce some basic notions and notations. 

Denote {0, 1} by B, the set of nonnegative integers {0, 1, 2, . . . } by N. Let S be a finite alphabet 
with at least two symbols. We consider the sequences over this alphabet, i. e., the mappings 
(j: N — > S. The set of all such sequences forms Cantor metric space. Denote this space by S^. 
Then lim„^oo Xn = if Vi 3n Vm > n Xm{i) = (this definition works for finite Xn too). 

Denote by S* the set of all finite strings over S including the empty string A. If i < j 
are nonnegative integers, denote by the segment of N with ends in i and j, i. e., the set 
+ l,i + 2, . . . Also denote by j] a substring uj{i)uj{i + 1) . . . uj{j) of a sequence uj. A 
segment [i,j] is an occurrence of a string a; € S* in a sequence uj if j] = x. We say that x ^ A 
is a factor of if a; occurs in uj. The string of the form cj[0, i] for some i is called a prefix of to, and 
respectively the sequence of the form uj(i)Lo{i + l)a;(z + 2) . . . for some i is called a suffix of to and 
is denoted by uj[i, oo). Denote by \x\ the length of a string x. The occurrence x = uj[i,j] in uj is 
fc-aligned if A;|i. Imagining the sequences going horizontally from the left to the right, we use terms 
"to the right" and "to the left" to talk about greater and smaller indices respectively. 

2 Almost periodicity 

A sequence uj is periodic if for some T we have uj{i) = uj{i + T) for each z E N. This T is called a 
period of uj. The class of all periodic sequences we denote by V. Let us consider some extensions 
of this class. 

A sequence uj is called almost periodic if for any factor x uj occurring in it infinitely many 
times there exists a number I such that any factor of uj of length I contains at least one occurrence 
of X. We denote the class of all almost periodic sequences by AV. 

A sequence uj is called strongly almost periodic if for any factor x oi u) there exists a number I 
such that any factor of uj of length / contains at least one occurrence of x (and therefore x occurs in 
uj infinitely many times). Obviously, to show strong almost periodicity of a sequence it is sufficient 
to check the mentioned condition only for all prefixes but not for all factors. Denote by SAV the 
class of all strongly almost periodic sequences. 

We also introduce an additional definition: a sequence uj is eventually strongly almost periodic 
if some its suffix is strongly almost periodic. The class of all eventually strongly almost periodic 
sequences we denote by SAV. 

Suppose UJ € SAV. Denote by pr(a;) the minimal n such that uj[n, oo) € SAV. Thus for each 
m ^ pr(i^) we have uj[m, oo) G SAV. 

A function : N — > N is an almost periodicity regulator of a sequence uj € AV, if 

(1) every string of length n occurring in uj infinitely many times, occurs on any factor of length 
R^{n) in uj; 

(2) any string of length n occurring finitely many times in uj, does not occur in uj[j{^{n), oo). 

The latter condition is important only for sequences in AV \ SAV. Notice that regulator is not 
unique: any function greater than regulator is also a regulator. 
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Obviously, V C SAV C 8AV C AV. In fact, all these inclusions are strict. For instance the 
famous Thue-Morse sequence ojt = 0110100110010110 . . . (see |1,S([T] or Section0J) is an example of 
the element in SAV but not in V (moreover, SAV has cardinality continuum while V is countable, 
see [Sj or j2j for proofs). The inequality SAV C £AV is obvious. Let us prove SAV C AV. 

Theorem 1. There exists a binary sequence uj G AV \ SAV. 

Proof. Construct a sequence of binary strings oq = 1, ai = 10011, 
02 = 1001101100011001001110011, and so on, by this rule: 

where x is a string obtained from x by changing every to 1 and vice versa. Put 
and 

(J = C0C1C2C3 . . . 

Let us prove that oj G AV \ SAV. 

The length of a„ is 5", so the length of cqCi . . . c„_i is 4(1 + 5 + • • • + 5"^-*^) = 5" - 1. By 
definition, put 

= 5" - 1 = |coCi . . .c„_i|. 

Let us show that uj is almost periodic. Suppose x ^ A occurs in lo infinitely many times. Take 
n such that |x| < 5". Suppose is an occurrence of x in w such that i > In. By construction, 
for any k we can consider uj[lk,oo) as a concatenation of strings and a^. Thus (by assumption 
about i) the string x is a substring of either a„a„, a„o„, a„a„ or a„a„. Notice that 10011 contains 
all strings of length two (00, 01, 10 and 11), so a„+i contains each of a„a„, ana„, a„a„,, anCin- 
Hence x is a substring of a^+i- Similarly, x is a substring of a„+i. In each factor of length 2|a„+i| 
of uj[ln+i, 00), a„+i or On+i occurs. Hence for / = (S""*"^ — 1) + 2 • 5"'^"'^ the string x occurs on every 
factor of length I in to. 

Now let us prove that for any n > the string Cn does not occur in uj[ln+i, 00). This implies 
that Cn occurs finitely many times in the suffix uj[ln, 00), i. e., this suffix is not strongly almost 
periodic. Therefore uj is not eventually strongly almost periodic. 

Let v = a;[/„+i,oo). As above, for each A;, 1 < A: < n + 1, is a concatenation of strings 
and Ofc. Assume c„ occurs in u and let [i,j] be one of this occurrences. For n > the string 
Cn begins with ai, hence [i,i + 4] is an occurrence of ai in i^. We see that oi = 10011 occurs in 
aioi = 1001110011, aiai = 1001101100, oioi = 0110010011 or aioi = 0110001100 only in 0th or 
5th position. Thus is 5-aligned, hence u and c„ can be considered as constructed of "letters" 
ai and ai, and we assume that Cn occurs in v. Now it is easy to prove by induction on m that 
is 5'"-aligned for 1 ^ m ^ 71, i. c, W6 can consider u and. Cn to be constructed of "letters" 0-777, and 
Um, and assume that c„, occurs in (the base for m = 1 is already proved, and we can repeat the 
same argument changing 1 and to Om and and taking into account that Cn begins with am for 
each 1 < m < n). 

Therefore we have shown that is 5"-aligned, hence if we consider v and c„ to be constructed 
of "letters" a„ and a„, then c„ = ananO-nO-n occurs in u. But notice that in any sequence constructed 
by concatenation of strings ai = 10011 and ai = 01100 there is no any occurrence of 0000 or 1111. 
That is why Cn also can not occur in u. This is a contradiction. □ 
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Moreover, it is quite easy to modify the proof and to show that AV \ SAV has cardinality 
continuum. For instance for each sequence r: N — > {4, 5} we can construct uJr in the same way as 
in the proof of Theorem ^ but instead of c„ we take 

(r) _ 

— ^nO-n • • Q^n • 

Tin) 

Obviously, all oj-r are different for different r and hence there exists continuum of various r. 

3 Finite automata mappings 

It seems interesting to understand whether some transformations of sequences preserve the property 
of almost periodicity. The simplest type of algorithmic transformation is finite automaton mapping. 
Another motivation, less philosophical, is that finite automata mappings were one of the most useful 
tools in while studying almost periodicity and finding some criterion for first-order and monadic 
theories of unary functions over N to be decidable. 

Finite automaton is a tuple F = (S, A, Q, g, /), where S and A are finite sets called input and 
output alphabets respectively, Q is a finite set of states, g G Q is the initial state, and 

/iQxS^gxA 

is the transition function. For a € consider the sequence /3(n))J^Q, where pn G Q, [3{n) € A, 
and assume Po = Q and (p„+i,/3(n)) = f{pn,a{n)) for each n. Then we call /3 = F{a) a finite 
automata mapping of a. If [i,j] is an occurrence of a string x in a, and pi = q, then we say that 
automaton F comes to this occurrence of x being in the state q. 
In jl2| El the following statement was proved. 

Theorem 2. If F is a finite automaton and uo G AV , then F(uj) E AV. 

We can prove a counterpart of this statement for eventually strongly almost periodic sequences. 

Theorem 3. If F is a finite automaton and uo G £AV, then F(ij) E SAV. 

Proof. Obviously, it is enough to prove the theorem for uj £ SAV, since prefix does not matter. 

Thus let UJ G SAV. By Theorem |21 F{u;) £ AV. Suppose F{uj) is not eventually strongly 
almost periodic. It means that for any natural there exists a string that occurs in F(uj) after 
position and does not occur after that. Indeed, if we remove the prefix [0, A^] from F(u;), we do 
not get strongly almost periodic sequence, hence there exists a string occurring in this sequence 
only finitely many times. Then take its rightmost occurrence. 

Let [io, jo] be the rightmost occurrence of a string yo in ^i^)- For some Iq the string xq = ui[io,jo] 
occurs in every factor of the length Iq in uj (by the property of strong almost periodicity). If F 
comes to io in the state qo, then F never comes to righter occurrences of x in the state go because 
in this case automaton outputs yo completely. 

Now let [r,s] be the rightmost occurrence of some string a in F(uj), where r > + ^o- On 
the factor uj[r — lo,r] there exists an occurrence [r', s'] of the string xq. By definition of r we have 
r' > iQ. Thus assume 

k = r', ji = s, xi= a;[ii, ji], yi = F{uj)[ii, ji]. 

Since a does not occur in F{uj) to the right of r, then yi does not occur in F(uj) to the right of ii, 
for it contains a as a substring. Therefore if the automaton comes to the position ii in the state qi, 
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then it never comes to righter occurrences of xi in the state qi. Since xi begins with ujlr', s'] = xq, 
and r' > iq, we get qi 7^ go- We have found the string xi such that automaton F never comes to 
occurrences of xi to the right of ii in the state qo or qi. 

Let m = \Q\. Arguing as above, for k < m we construct the strings Xk = ui[ik,jk] and 
corresponding different states q^ , such that F never comes to occurrences of x^ in uj to the right of 
ik in the states qo, qi, . . . , qk- For k = m we have a contradiction. □ 

Notice that this proof is non-effective in the following sense. Suppose we know lo G SAV and 
its almost periodicity regulator R^^. Then by Theorem |S1 some upper bound on pr(F(a;)) exists for 
F{lli) G SAP, but the presented proof does not allow us to obtain any such bound. 

Theorem was proved first in jS]. The following effective version of this theorem was announced 
in 0. 

For a function g denote g o g o ■ ■ ■ o g hy . 

n 

Theorem 4. Let F he a finite automaton with n states and to € SAV. Then F{uj) G SAV and 

pr(FH)^C(l)+Rri(l) + ... + R^(l). 

To prove this theorem, first we consider particular type of automata called reversible for which 
the statement of theorem is simple. Then we introduce some construction in combinatorics on 
words which allows us to reduce general situation to the case of reversible automaton. 

A finite automaton F = (S, A,Q,g, /) is reversible, if for any q ^ Q and a G S there exist 
unique q' G Q and 5 G A, such that f{q',a) = {q,b). In other words, in such an automaton each 
letter of the input alphabet T, performs a permutation on Q (output alphabet does not matter). 
If we have some state, we can reconstruct the sequence of previous states from the sequence of 
previous input letters (this is a reversibility property). 

Theorem 5. If F is a reversible finite automaton and lo G SAV, then F{uj) G SAV. 

Proof. Suppose x occurs in uj, and F comes to this occurrence in the state q. Our goal is to prove 
that the next time when F comes to x in w being in the state q, is at some distance of the previous 
such situation, and we can also give upper bound for this distance in terms of |x| and R^^. It means 
that the same estimate for this distance works for any situation when F comes to x in the state q. 
So it is enough for our purpose. 

Let xq = uj[r, s] be a factor of uj; the automaton comes to this occurrence in some state q. Let 
[^Oiio] be the next occurrence of xq in uj, then jo ^ r + Iiw{\x\) + 1. If F comes to this occurrence 
being in the state q, then all is done. Otherwise F comes to io being in the state qo 7^ q. Let 
xi = uj[r,jQ], and suppose ji] is the next occurrence of xi in uj, so ji ^ + Raj(R(j(|2;|) + !) + !. 
Suppose the automaton comes to the position ii + io being in the state qi. If qi = q, then all is 
done for uj[ii + io, Ji] = xo- If qi = qo, then F comes to the position ii in the state q, since F is 
reversible, and all is done again. If it is not the case, qi q and qi qo- 

Similarly, for X2 = uj[r,ji] and its occurrence [^2,^2] in ^, such that i2 > r and j2 ^ r + 
Rcj(Ra;(Ra;(|2;i) + 1) + 1) + 1, either we are done or F comes to the position i2 + ii+ io in the state 
q2 where q2 Q2 Qo and q2 qi- Arguing in the same way, for /c < m = \Q\ we construct the 
strings xo,xi, . . . ,Xk with occurrences [io, Jo], [ii, ji], • • • , [ifc, jfc] and different states go, qi, . . . , qk-i, 
such that in worst case F can not come to the position ik + ik~i + • • • + io in states q,qo, . . . , qk-i- 
Thus for k = m we are done for sure, and the estimate for distance will be /(/(... (|x|) ... )), where 
/ = Rij +1 and the number of iterations is m. □ 
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For (J G S^, € define uj x u £ {T. x A)^ such that {u; x v){i) = {uj{i), v{i)). 
Corollary 6. //w G SAP and u £V, then lo x u e SAV. 

Proof. Operation "x" with periodic sequence can be simulated by cyclic finite automaton which is 
obviously reversible. □ 

Remark 7. Let us formulate some open questions connected with Corollary [HI Let oj,u ^ SAV. 
Then it is interesting to know what we can say about ujxu. It is not difficult to construct uoxu ^ AV 
or tj X z/ G £AV \ SAV. Can we construct oj x u ^ AV \ £AV1 Does there exist any criterion to 
determine whether u; x i/ G AV^. An example of G AV with uj x v ^ AV can be found in [7]. 

Now consider the following construction. Let w G S^, and suppose a G S occurs in lo infinitely 
many times. Cut uj on the blocks like xa, where x G (S \ {a})*, i. e., on the blocks containing a 
symbol a on the end and not containing any other occurrences of o. To make this we need to cut 
after each occurrence of o. If a occurs in uj at bounded distance, then the number of all such blocks 
is finite (for example, if a; G AV , then the length of blocks is not more then Ra;(l)). Encode these 
blocks by symbols of some finite alphabet, denote this alphabet by ba,aj(S). Thus we obtained a 
new sequence in this alphabet from a;. Delete the first symbol of this sequence. The result is called 
an a-split of w and is denoted by Sa{io). For example, 0-split of the sequence 3200122403100110. . . is 
(0)(12240)(310)(0)(110). .. 

Lemma 8. Let uj G SAV, and suppose a G S occurs in uo. Then Sq(w) g SAV. 

Proof. Let k be the maximal length of the a-split blocks. Consider a prefix x of Sa{'^)- The 
corresponding string y in w is not longer than k\x\. Let z = ay, \z\ ^ k\x\ + 1. The string z occurs 
in UJ. Therefore z occurs on any factor of length / = Rt^(A;|x| + 1) in uj. The first and the last 
symbols of z are a, so every such occurrence is well-aligned relative to a-split of uj. Hence for any 
occurrence of z in a; there is an occurrence of x in Sa{uj). Therefore x occurs on each factor of 
length R^{k\x\ + 1) in 8^(0;). □ 

Remark 9. In connection with Lemma |H1 an interesting question appears, a particular case of the 
question in Remark [7| Instead of splitting uj on blocks with some fixed symbol at the end, we can 
split UJ arbitrarily on blocks of various lengths. When the result is strongly almost periodic or just 
almost periodic? 

Now we can prove the promised theorem. 

Proof of Theorem^ Let F = (S, A,Q,g, /) and \Q\ = n. We construct an algorithm to compute 
some 

/ ^ Pt{F{uj)), 

and at the same time we prove 

^^c(i)+Rr'(i) + ---+R^(i)- 

Assume that any automaton in the proof has the maximum possible output alphabet "input 
alphabet" x "the set of states" (general case can be obtained from this by projection). For example 
for F this isT,xQ. Correspondingly the transition function / writes the pair of a current state and 
an input symbol to the output. Further we omit the second part of the transition function value 
(i. e., for instance, instead of f{p,a) = {q,h) we write just f{p,a) = q with f{p,a) = {q, {p,a)) in 
mind) . 
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Let ujQ = uj. Suppose every symbol of S occurs in ujq, elsewise we restrict F only on the symbols 
occurring in ujq; to determine these symbols effectively we should read first Ra;o(l) symbols of wo- 
lf F is reversible, by Theorem [5] we get pi{F{lvq)) = 0. Otherwise some symbol oq € S 
accomplishes not one-to-one mapping of Q, so the set 

Qi = {q : 3q' f{q',ao) = q} 

is the proper subset of Q. Consider 

^1 = Sao ( Wo)) 

which is strongly almost periodic by Lemma |H1 Notice that starting in any state on wq, the 
automaton F comes to any block of oo-split of ujq in the state of the set Qi, because every such 
block has qq at the end. 

Let us construct a new automaton Fi (effectively by F). Let the input alphabet of Fi be 
bao,(^o(^)) the set of states be Qi, and the value of the transition function on x & hao,uioi'^)^ q ^ Qi 
be the output of F starting in the state q on the string x written in symbols of S. Let the initial 
state of Fi be the state of F after the work on the prefix of u until the first occurrence of ao (the 
prefix which we delete obtaining Sag(a;o) from ujq). Now the work of Fi on lui simulates the work 
of F on ujQ. Notice that ivi is obtained from uj by deleting not more than Ra;o(l) first symbols, 
counting in the alphabet S. 

We have the sequence uji (in the alphabet more than initial) and the automaton Fi with the 
set of states less than initial. If Fi is not reversible, then we can repeat the procedure of the last 
paragraph. Thus we obtain the sequence uj2 in some alphabet bai,a;i (bao,a;o(^))) the automaton 
F2 with the set of states less than previous, working on u!2- The sequence UI2 is obtained from uji 
by deleting not more than Rtji(l) first symbols, counting in the alphabet bao,a;o(^)- Therefore u)2, 
written in the initial alphabet S, is obtained from uj by deleting not more than R^^p (R^^,, (1)) +Rcjo (1) 
first symbols, counting in the alphabet S. 

An automaton with a single state (and with arbitrary input alphabet) is always reversible. 
Hence after k repetitions of described procedure for some k ^ n, we get the situation when the 
reversible automaton works on strongly almost periodic sequence lo^ in some alphabet (after 
each repetition of the procedure the number of states decreases). The symbols of this alphabet 
code the blocks of initial sequence. Thus F].{oJk) € SAV. 

Writing uok in the alphabet S, we get some suffix uo' obtained from uo by deleting a prefix not 
longer than 

R' (1) + R^'(l) + • • • + R..(l) ^ R"(l) + Rr'(l) + • • • + R..(l)- 

It only remains to check why Fk{uJk) € SAV implies F{uj') G SAV. Let us explain this in one 
simple case when the automaton Fi obtained after the first iteration of procedure is reversible (the 
general situation can be reduced to this case by induction) . Then uj' is obtained from uj by deleting 
first symbols until the first occurrence of oq. Let the initial state of Fi (in which F comes to uj') 
be q. To show F{uj') G SAV it is necessary and sufficient to check whether for any prefix of uj' 
the occurrences of its copies in uj', in which F comes in the state q, are quite regular, i. e. these 
copies occur on each factor of length / for some / (sufficient condition is obvious, necessary condition 
follows from our requirement for automata always to output the pair (input symbol, current state)). 

Let X be a prefix of uj' ending by oq (arbitrary prefix is contained in some such prefix). We can 
correctly split it on blocks ending by oq, denote this split by y. The automaton Fi is reversible, 
so -Fi(ti;i) € SAV. By the necessary and sufficient condition of the previous paragraph Fi comes 
to y in the state q on each factor of length t for some t. Every such situation corresponds in uj' 
to coming F to some occurrence of x in the state q, and this happens on each factor of length tk, 
where k ^ Rtj(l) is the maximal length of blocks. □ 
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The upper bound on pr(-F(a;)) in Theorem |1] can not be significantly improved, as it follows 
from the construction in |l()j after small modifications. 

It is interesting that now we have two different proofs of Theorem |21 and it seems that there is 
no any connection between them. 

The results about finite automata mappings can be extended on more general class of mappings 
done by finite transducers. 

Let S and A be finite alphabets. The mapping h: T,* ^ A* is called a homomorphism, if for 
any u,v G S* we have h{uv) = h{u)h{v). Clearly, any homomorphism is fully determined by its 
values on single- letter strings. Let to E S^. By definition, put 

h{uj) = h{uj{0))h{uj{l))h{uj{2)) . . . 

Suppose /i: S* — > A* is a homomorphism, uj G is almost periodic. In [7j it was shown that 
if h{uj) is infinite, then it is almost periodic. Thus obviously if to is strongly almost periodic, and 
h{uj) is infinite, then h{oj) is also strongly almost periodic. Indeed, it is enough to show that any v 
occurring in /i(a;) occurs infinitely many times. However there exists some factor u of w such that 
h{u) contains v, but by the definition of strong almost periodicity u occurs in to infinitely many 
times. Evidently, for iv € £AV we have h{uj) G SAV, if h{uj) is infinite. 

Now we modify the definition of finite automaton, allowing it to output any string (including 
the empty one) over output alphabet reading only one character from input. This modification is 
called finite transducer (see |14j). Formally, we only change the definition of translation function. 
Now it has the form 

/: Q X S ^ Q X A*. 

If the sequence {pn,'Vn)^=o, where pn G Q, Vn & A*, is the mapping of a, then the output is the 
sequence voViV2 ■ ■ ■ 

Actually, we can decompose the mapping done by finite transducer into two: the first one is 
a finite automaton mapping and another is a homomorphism. Each of these mappings preserves 
the class AV, so we get the corollary: finite transducers map almost periodic sequences to almost 
periodic. Similarly, by Theorem |31 and arguments above we also get the following 

Corollary 10. Let F be a finite transducer, u € £AV. Suppose F{uj) is infinite. Then F{uj) £ 
£AV. 

4 Effectiveness 

Lots of interesting algorithmic questions naturally appear in connection with almost periodicity, 
i. e., if one can check some property or find some characteristic algorithmically being given a 
sequence. Sometimes these questions are just effective issues for corresponding noneffective results, 
for example Theorem ^ is an effective variant of Theorem El Further, we mainly deal with the 
case when the answers on these questions are negative. We prove that some properties do not have 
effective analogs. 

Formally, we consider an algorithm with an oracle for a sequence on input. This algorithm 
halts on every oracle and outputs a finite binary string or any other constructive object. The 
main property of such an algorithm is continuity: it outputs the answer on having read only 
finite number of symbols from the sequence. Thus to prove non-effectiveness we only need to 
show discontinuity. In fact, such proofs are just concrete complicated combinatorial constructions 
showing this discontinuity. 
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If we have only a sequence, then we can not recognize almost any property about this sequence. 
For example it is even impossible to understand whether the symbol 1 occurs in given binary 
sequence: if an algorithm checks some finite number of symbols and all these symbols are 0, then 
it can not guarantee that 1 does not occur further. The question about algorithmic decidability 
becomes more interesting if we allow to give on input some additional information. In the case of 
almost periodic sequences it may be an almost periodicity regulator. 

It is easy to decode unambiguously functions N ^ N and also pairs (sequence, function) by bi- 
nary sequences. That is why we can correctly consider algorithms with an almost periodic sequence 
Lj and its regulator / on input. 

From this point of view the above problem can be solved effectively: reading first /(I) symbols 
of the sequence we can say whether or not 1 occurs in it, and moreover reading next /(I) symbols 
we can say whether 1 occurs in it finitely or infinitely many times. 

The following several theorems are examples of problems concerning almost periodicity which 
do not have effective analogs. It is especially interesting that the Theorem results are absolutely 
contrary to the results of Theorem |31 Theorem is also connected with Theorem 0] All the 
following theorems were announced first in 

We say /„ ^ / for /„, / : N ^ N if Vi 3n Vm > n /^(f) = f{i). 

Theorem 11. Given uo £ £AV and its regulator f, it is impossible to compute algorithmically 
some I ^ pi'(<-^). 

Remind that ujt is the Thue-Morse sequence. This sequence can be obtained as follows: let 
oq = 0, ffln+i = o-nO-n, and ujt = lim„_^oofln- Notice that |a„| = 2". The Thue-Morse sequence has 
lots of interesting properties (see but we are interested in the following one: lot is cube- free, 
i. e., for any a € M* , a ^ A the string aaa does not occur in lot (see [Tl IT^). 

Proof of TheoremllU It is enough to construct LOn S £AV, lo G SAV with regulators /„, / such 
that uon LO, fn ^ f, but pr(a'„) — > cxd. Indeed, suppose the mentioned algorithm exists and it 
outputs some I ^ (arbitrary for lo € SAV) given {lo, f) on the input. During the computation 
of I the algorithm reads only finite number of symbols in lo and of values of /. Hence there exists 
N > / such that algorithm does not know any Lo{k) or f{k) for k > N. Since pr(a;„) oo, there 
exists n such that pr(u;„) > A'^. The algorithm works on the input {LOn, fn) in the same way as it 
works on the input {lo, /), and then outputs /, but pr{LOn) > N > I. 

Let LO = LOT, = anOnUnLO. Notice that pr(a;„) ^ 2". Indeed, if pr(a;„) < 2", then UnOnLO = 
anininO-nO'nO'n • • • £ SAV, and hencc ananOn occurs in uot — contradiction with the statement 
before the proof. 

It only remains to show that we can find regulators /„, / for lo^, lo such that fn^f- It 
is sufficient to find the same regulator g for all uOn (then we can increase it and obtain the same 
regulator for all uOn and for uo too). Fix some R^^ and assume g = ^ ■ R^. Let v, \v\ = k occur in 

= ananOnUJ infinitely many times. Let us take the factor of length 4 • Ra,(fc) and show 

that V occurs in it. If j ^ 3 • 2" -|- Raj(fc), then v occurs on the factor uj[3 ■ 2"',3 • 2" -|- R(^(A;)] 
(by definition of R,^). Otherwise j < 3 • 2" Ruj{k), hence i ^ 3 • 2" - 3R<^(fc). But i ^ 0, 
therefore Ku){k) ^ 2" = \an\. Then LOn[i, i + Kuj{k)] is contained in o^an- But a„a„ occurs in lo, so 
ujn[i,i + Raj(fc)] occurs too. Therefore v occurs in lo. 

However g is not already required. We should watch on the strings occurring in LOn finitely 
many times. Obviously, if some v occurs in w„ finitely many times, then \v\ = k > 2" (otherwise 
V occurs in two consequent strings a„ or and thus in lo). Therefore this can happen only for 
finite number of different n. Considering all the situations when strings of length k occur in some 
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iOn finitely many times, we probably increase the value g{k), but only finitely many times. Thus 
the required estimate for regulators exists. □ 

We have already seen that SAP C AV (Theorem Using the same construction we can show 
that it is impossible to separate these classes effectively. 

Theorem 12. Given oo € AV and its regulator f , it is impossible to determine algorithmically 
whether uj G £AV. 

In [7j the following universal method for construction of strongly almost periodic sequences was 
presented. This method is based on block algebra on words introduced in 6 and then studied 
in 0. 

The sequence {An, In), where An C S* for some finite alphabet S, In G N, is called strong 
Ti-scheme, if the following conditions hold: 

(1) all the strings in An have the length /„; 

(2) any string u S An+i has the form u = V1V2 ■ ■ - Vk, where Vi £ An, and for every w € A„ there 
exists i such that Vi = w. 

We say that a € is generated by strong S-scheme {An, In) if for every i and n we have 

a[iln, {i + l)ln - 1] G An. 

It is easy to see (by compactness) that any strong scheme generates some sequence. In 0, the 
authors prove that any sequence generated by strong scheme is strongly almost periodic. Moreover 
every strongly almost periodic sequence is generated by some strong scheme. 

Proof of TheoremM'A It is enough to construct cj„ G £AV, oj € AV\£AV with the same regulator 
/ for all bJn such that a;„ — > w. 

In the same way as in Theorem ^ assume oq = 1, and then by the rule: On+i = ananflnO-nO-n- 
Denote anOnOnan by c„. Put Z„ = 5" — 1 = |oCi . . . n-i|- Consider uj = 0123 • • • and u = lim„^oo cLn- 
From the proof of Theorem ^ it follows that lo € AV \ £AV. Let ujn = cqCi . . . c„i^. The sequence 
v is generated by the strong IB-scheme ({a„, o„}, 5"), hence v € SAP. Therefore uJn € £AV. 
Obviously, uJn — ^ and it only remains to find common regulator /. We will get finite number of 
conditions of the form f[k) ^ a, then we can take the maximum among all these a. 

Let V = ijjn[i,3], \v\ = k occurs in uJn = cqCi . . . CnV infinitely many times. Then v occurs in v, 
hence in Om for some m too. Therefore v occurs in u) infinitely many times and it is sufficient to 
take f{k) ^ R^(A:) + R^(A;). 

Let V = ujn[i,j], \v\ = k occurs in ujn finitely many times. Then i < In- Suppose j > In. If 
A; ^ 5", then v occurs in for some m and hence occurs in v infinitely many times. But the 
inequality A; > 5" holds only for finite number of different n, and this yields just finitely many 
conditions on f{k). Now suppose j ^ /„. But then v occurs in cqCi . . . c„ and occurs in to finitely 
many times (otherwise v occurs in for some m). Therefore in this case it is sufficient to take 
f{k) ^ K.ik). □ 

The following theorem shows that it is even impossible to separate effectively SAV and V. 

Theorem 13. Given lo € SAV and its regulator f , it is impossible to determine algorithmically 
whether uj £ V. 

Proof. It is enough to construct uJn & V, uj & SAV \ V with common regulator / for all ujn such 
that UJn UJ. 
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Every strongly almost periodic sequence can be obtained from the strong S-scheme {An,ln)- 
Let us strengthen the main condition on A^. let us consider strong schemes such that for each 
n G N every u G An+i has the form u = V1V2 ■ ■ ■ Vk, where Vi G An, and for any 'Wi,W2 € An there 
exists i < k such that WjWj+i = wiW2- Notice that such schemes exist and can generate non-periodic 
sequences, e. g., ({o„,o„},2") generates ujt- 

Let {An, In) be the strong scheme satisfying the strengthened condition from the previous para- 
graph, generating uj ^ V. Let pn = a;[0,/n]- Thus pn G An and lim„^ooPri = ^- Assume 

= PnPnPn ... € P. Obviously ujn ^ and it only remains to find some common regulator / for 
all Un- 

Let V = ujn[i,j], \v\ = k (since uJn ^V, it follows that v occurs in uJn infinitely many times). 
The inequality k ^ |p„,| = /„ holds only for finite number of different n, and this yields just finitely 
many conditions on f{k). Now we can assume that k < In- Take t such that It^i < k ^ It (it 
is important that t does not depends on n and is uniquely defined by k). Then t < n. There 
exists m such that mlt ^ i and j ^ {m + 2)lt, i. e., v occurs in some ab, where a,b G At. Then 
by the scheme property v occurs in any c G ^t+i- But on every factor of uJn of length 2/t_|_i there 
exists an occurrence of some c € ^t+i (fully contained in some Pn)- Therefore it is sufficient to 
take f{k)^2lt+i. □ 

By the argument of Theorem we obtain that there exists infinite set of periodic sequences 
with common regulator (while the period tends to infinity). This construction can be used in the 
following theorem: adding one symbol to the strongly almost periodic sequence we can not check 
whether it is still strongly almost periodic. 

Theorem 14. Given uj € EAV, its regulator f and some I ^ pr(w), it is impossible to find 
algorithmically pr(a;). 

Lemma 15. If auj £ SAV for a € S* and uj £ V with period I, then acu € V with period I. 

Proof. It is enough to prove lemma for single-letter a. Let a = 012 ...(/ — 1)012 ...(/ — 1)012 ...(/ — 
1) . . . be periodic sequence over alphabet = {0, 1, 2, — 1}. Then by Corollary [S] we have 
ato xa £ SAV. In this sequence the symbol {a, 0) occurs infinitely many times, hence a = u;(Z). □ 

Proof of Theorem \14\ It is enough to construct uJn G SAV, uj € SAV with common regulator / for 
all UJn such that 0;^ — > w and pr(ci;„) = 1 {uj € SAV means pr(a;) = 0). 

Notice that Iujt & SAV. Indeed, for each n strings OnOn and a^a^ occur in ujt, and hence Ian 
too. Analogously Oujt G SAV. 

By proof of Theorem 1131 we can choose sequence A;„ — > cxd such that all periodic sequences 
like a;(0) . . . uj{kn)uj{0) . . . uj{kn)uj{0) . . . have common regulator /. Take a subsequence of the 
sequence /c„ such that all the symbols u){mn) are equal. Suppose these symbols are 0. 

Let UJn = lci;(0) . . . uj{mn)uj{0) . . . a;(m„)a;(0) . . . and uj = Iujt- There exists common estimate g 
on the regulator for these sequences. Indeed, it is sufficient g{k) ^ f{k) + 1 (by considering strings 
occurring infinitely many times) and g{k) ^ k (by considering strings occurring only finitely many 
times: this can happen only for prefixes occurring exactly once). 

If UJn G SAV, then by Lemma^lwe have uJn £ V with period But ^^(0) = 1 7^ uJn{mn) = 0. 
Therefore pr(u;„) = 1. 

The case when all the symbols uj{mn) are 1 is analogous (then uJn begins with 0). □ 
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